Employing feedback in adiabatic quantum dynamics 
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We study quantum adiabatic dynamics, where the slowly moving field is influenced by system's 
state (feedback). The information for the feedback is gained from non-disturbating measurements 
done on an ensemble of identical non-interacting systems. The situation without feedback is governed 
by the adiabatic theorem: adiabatic energy level populations stay constant, while the adiabatic 
eigenvectors get a specific phase contribution (Berry phase). However, under feedback the adiabatic 
theorem does not hold: the adiabatic populations satisfy a closed equation of motion that coincides 
with the replicator dynamics well-known by its applications in evolutionary game theory. The 
feedback generates a new gauge-invariant adiabatic phase, which is free of the constraints on the 
Berry phase (e.g., the new phase is non-zero even for real adiabatic eigenfunctions) . 

PACS numbers: 03.65.-w, 05.30.Ch, 03.65.Vf 



The adiabatic theorem of quantum mechanics governs 
the evolution of a quantum system subject to slowly vary- 
ing external fields. Its applications span a vast array of 
fields, such as two-level systems (nuclei undergoing mag- 
netic resonance or atoms interacting with a laser field), 
quantum field theory (where a low-energy effective the- 
ory is derived by integrating out fast, high-energy degrees 
of freedom), and Berry's phase [J, [3, S|- This phase and 
the adiabatic theorem also find applications in quantum 
information processing 0, Q . For a recent discussion on 
the validity of the adiabatic approach see @ . 

A general perspective of the quantum adiabatic physics 
is that it studies a system subject to a slow, open loop 
(i.e., no feedback) control, where the evolution of the ex- 
ternal fields is given a priori via time-dependent param- 
eters of the system Hamiltonian. In view of numerous 
application of this setup, it is natural to wonder about 
the quantum adiabatic closed-loop control, where the ex- 
ternal controlling fields evolve under feedback from the 
controlled quantum system. Any feedback needs infor- 
mation on the evolution of the system. This information 
is to be gained via measurements, which in the quan- 
tum situation are normally related with unpredictable 
disturbances and irreversibility. Thus quantum control 
has been restricted to open-system dynamics 

However, also quantum measurements can be non- 
disturbing, if N non-interacting quantum particles 
(spins, etc) couple to the proper measuring apparatus. 
For N ^ 1 [analog of the classical limit] one can mea- 
sure single-particle observables (almost) without disturb- 
ing the single-particle density matrix, since the distur- 
bance caused by such measurements scales as where 
a is the measurement precision [8|. The knowledge of 
these observables allows to implement feedback . Non- 
disturbing measurements on ensembles of few-level sys- 
tems are routinely employed in NMR physics (e.g . , in 
ensemble computation) and quantum optics 13, 

Here we develop adiabatic theory under feedback ob- 
tained via such non-disturbing measurements. 



Basic equations. Consider a d-level quantum system 
described by a pure state lip) (generalization to mixed 
states is indicated below). The system evolves according 
to the Schroedinger equation with Hamiltonian H[R{t)], 
where R{t) is a classical controllling parameter (fi, = 1): 



im)) = H[R{t)] m))- 



(1) 



By means of a continuous non-disturbing measurement 
performed on an ensemble of identical, non-interacting 
systems (each one described hy \tp{t))) one finds the aver- 
age {ip{t)\A\ip{t)) of a monitoring observable A (in NMR 
physics A typically corresponds to the magnetization). 
This average enters the feedback dynamics of R 



R^eF{R, m)\A\m))^ 



(2) 



where e <C 1 is a small dimensionless parameter. We 
assume that F{., .) is bounded from above, which means 
that i? is a slow variable: its derivative is bounded by 
a small number. For F = F{R) (no feedback) we re- 
cover the standard adiabatic setup. The dynamics P]) 
conserves the purity of but the overlap {cj){t)\ip{t)) 

between two different wave-functions is not conserved in 
time, since H depends on \^{t)){ip{t)\ via ([2]). 

For a particular case F = —{^\dRH\^), Eqs. dUIS]) can 
be viewed as a hybrid dynamics, where a classical parti- 
cle with coordinate R performs an overdamped motion 
and couples to the quantum system. Then e in ([21) corre- 
sponds to an inverse damping constant, while {ipldnHlip) 
is the average (mean-field) force acting on the particle. 
Hybrid theories are f req uently employed in optics and 
chemical physics; see [13| for the current state of art. 

Let us now introduce the adiabatic eigenresolution of 
the Hamiltonian for a fixed value of R (n = 1, .., d): 



H[R] \n[R])=En[R] \n[R]), 



{n[R]\m[R]) ^Srnn.{i) 



For simplicity we assume that the adiabatic energy levels 
are not degenerate. The representation ([3]) has a gauge- 
freedom: \n[R]) e*""[-^l HR]), where a„[i?] IS an ar- 
bitrary single- valued function depending on n and R. All 
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observables should be gauge-invariant. Expand \ip{t)) as we get from pO|) [and likewise from ((21 [7])] 



(4) 



ln{t) 



At'Er,[R{t% Cr.it) = {n[R{t)] |^) e-'^^"(*), 



where 7n(i) are the dynamical phases, while c„ are the 
adiabatic amplitudes. One gets from (ITl[2l|4]): 

c„ = -e^^Cfe(n|fc')i^(i?,c,e*^'^(*))e*(^^W-^"W), (5) 

where \k') = dn\k[R]). The amplitudes c„ and R are 
slow variables, since, e.g., |c„| is bounded from above 
by the small e in ([5]). However, the contribution from 
the dynamical phases 7„ changes fast, since on the slow 



time T = it behaves as 



air Is. 



see dH). If the spac- 
ings between the adiabatic energy levels -E„[i?] remain 
large enough, the existence of some intermediate time Tf 
is guaranteed, over which the dynamical phase contri- 
bution performs many oscillations, but c„ and R do not 
change appreciably. The adiabatic approximation divides 
c„ into the time-averaged (over r/) part c„ and the small 
(at least as 0(e)) oscillating part: c„ = c„ -I- bcn [l^ . 
To leading order we neglect in the RHS of ^ all the 
oscillating factors and substitute c — + c and R^ R: 



-2^ Ck{n\k') F{R, c, e^^-r) e'(7fc-7,.), 



(6) 



where t = et, X = f^' ^ X{s), and where X' = dX/dr 
Linear feedback. The simplest example of feedback is 



p = {mm = 



* A 



(7) 



where (n|A|m) = Anm- Eq- can be regarded as the 
first term of the Taylor expansion assuming that F{x) 
depends weakly on its argument. Eq. ^ leads to 



knm 



Ck {l\k') clCmAnnr e'(7„.-7,.+7.-7,). (g) 



In working out ([H]) we shall assume that the time- 
integrated energy-level differences are distinct: 

lm{t) " Inif) ^ li{t) - Ikit), if TO 7^ n and m ^ I. (9) 

This condition is generic for few-level systems. It does 
not hold for cases like harmonic oscillator, which should 
be separately worked out from ([8|). Now in the RHS of 
([5]) the non-zero terms are those with ni ~ n and I ~ fc, 
and those with m = I and k = n (but n ^ I, not to count 
twice the term m = n = k = I): 

c^ = -cimR'-ciJ2 ,\cnmi\n') A^i, (10) 

where (^1^) is imaginary, since = 1. The nontrivial 

(second) term in the RHS of pO|) is due to non-diagonal 
elements of A. Defining the phase and module of c„. 



/Pn e 



Pn = 1, 



(11) 



p^ = -2piJ2 Vn'R{{l\n')A„t}, (12) 

^-^n{^l) 

0r - m') R'-J2 ,^nP- ^{ ('i'^') }' (13) 

(14) 



R — / PnAnn- 
' ^ n. 



Eqs. (|12f[l4)) are our central results. Before exploring 
them in more detail let us discuss the standard (open- 
loop, i.e., no feedback) adiabatics, where A — A{R) is 
a c-number. Now R moves in a prescribed way accord- 
ing to R' = A{R). Eq. leads to the conservation 
of the probabilities p' = (adiabatic theorem): the sys- 
tem does not get enough energy to move out of the given 
energy level [l|. The RHS of (fT3|) reduces to Berry's 
factor ; = i{l\l')R*. As seen from dU, though 0b, z 
is by itself not gauge- invariant, it does bring an observ- 
able (Berry phase) contribution in a non-diagonal aver- 
age over the state | V'(i) ) = En c„(0)e''^='.''(^)+^T"(*). The 
Berry phase was observed in numerous experiments; see 
[3, 9 for review. It is constrained by the following con- 
ditions. 1. The Berry phase nullifies, (/|/') ~ 0, if the 
adiabatic eigenvectors \l) can be made real via a gauge 
transformation, e.g., a spinless particle without magnetic 
field. (This statement does not hold if there are level- 
crossings.) 2. = for a cychc motion of a single 
slow parameter i?, where R is switched on at the initial 
time and then switched off at the final time. The Berry 
phase may be different from zero if there is more than 
one slow parameter R = (i?i,i?2, ■..) on a closed curve 
C: R(0) — R(t) 0- Then one gets a gauge-invariant 
expression (j)B,i = i d'R {l\du I) [2,[3|- 

Closed-loop adiabatics. Eq. (|12p for pi arises out of the 
averaging over the fast dynamic phases under condition 
([9]). Eq. p2|) is non-hnear over p„ due to the feedback. 
The probabilities Pn are no longer conserved [due to the 
resonance between the oscillations of c„ and those of R, 
see ©J, and if p„'s are known, the phases i/i; are obtained 
directly from (|13p . The matrix 



-25R{ (l\dRn) {n\A\l) }, 



-air, 



(15) 



in p2|) is antisymmetric; in particular, an — 0, which 
means J^iPii''') — 1- The edges of the probability sim- 
plex, e.g. pi = 6ii, are (possibly unstable) stationary 
solutions of (|12p . and piir) is always non- negative. 

It is noteworthy that (fT2| coincides with the replica- 
tor equation for a zero-sum population game 15, [l^ . 



Consider a population of agents that consists of groups 
Z = 1, .., d. The fraction pi of each group in the total pop- 
ulation changes due to interaction between the groups, so 
that p* is proportional to pi itself (autocatalyst principle), 
while the proportionality coefficient is the average pay- 
off of the group I: p' — pi J2n ^inPn O Here the 
payoff matrix a;„ determines the gain (or the fitness in- 
crease) of the group I in its interaction with the group 
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the [non-negative] relative entropy is defined as 



FIG. 1: Adiabatic amplitudes c„i versus r for a three-level 
system. c„; are obtained from solving (|22p in the case A — 
—OrH (hybrid dynamics). The external field is not acting 
on the first energy level: |(2|l')| = |(3|l'>| = 0; thus cn is 
constant. We put |{2'|3)| — 1. All |fc) are real (no Berry 
phases), and additionally the adiabatic energies are constant: 
All = —OrEi = 0; thus R is constant according to (|23ll . 
Normal curve: C23. Dashed curve: C12. Thick curve: C13. 
Thick dashed curved: C22. Recall that C33 -I- C22 = const. 



n. The actual mechanism of this interaction depends on 
the concrete implementation of the model (inheritance, 
learning, imitation, infection, etc) fl6|. The condition 
ttni = —a-in means a zero-sum game (e.g., poker): the 
gain of one group equals to the loss of the other. Thus in 
(|12p the population game, with (in general) r-dependent 
payoffs aim is now played by the energy levels. Inter- 
esting features of the replicator equation can be found 
without solving it; see (fT6] - [T9|) . 

For the open-loop control changing of R on the slow 
time-scale is mandatory, otherwise no adiabatic motion 
occurs at all. The closed-loop situation is different, since 
now for = the slow motion of R is absent, 

R' — [see ([T^]. with still non-trivial adiabatic dynam- 
ics. Thus R does move on the fast time, but this motion 
averages out on the slow time. Let us focus on this situ- 
ation, since we cannot study (fT2UT4|) in full generality. 

Eqs. (|12l lisp , now with T-independent ai„, is conve- 
niently studied via the time-averages [l^ : 



lln^= Va,„p„(r), p„(r)- r^p„(r).(16) 



T PiiO) 



T 



There are now two different dynamic scenarios depending 
on the concrete form of r-independent aip in [TS]) . 

1. If all pi(t) (which were non-zero at the initial time 
T = 0) stay non-zero for all times, lnp/(T) in the LHS 
of (fTC)) is limited, which means that this LHS can be 
neglected for T ^ cx). We then get from (fTB|) [islllij 



EainPn{oc) = 0. 



(17) 



Thus all pi (t) may remain non-zero for all times provided 
that there is a probability vector p{oo) that satisfies (IT71) . 
Clearly, p(oo) is a stationary state of (fT^[T5)) . Recall that 



S[p{ooMt)] 



2^^Pi(oo)ln[p;(oo)/pi(r)] 



(18) 



where p{t) is a time-dependent solution of (|12p . 
S[pn{oo)\p{T)] is equal to zero if and only if p(oo) = p{t). 
Due to (fTT]) . S[pn{oo)\p{t)] is a constant of motion [thus 
an adiabatic invariant], since 



E, Pl{T)ainPn{oo) 
In 



(19) 



This constant can be associated with Hamiltonian, and 
then can be recast into a Hamiltonian form [ll ]. 
The non-linearity of this dynamics is essential, since it 
can demonstrate chaos for d > 5 [13] • In some closely 
related systems the chaotic behavior was seen in (l7| . 

2. If the matrix ain is such that (fT7|) does not have any 
probability vector solution, y In in (fTB|) is necessar- 
ily finite for at least one I. The corresponding probability 
Pi[T) goes to zero (for a large T): pi{T) pi{oc) — 0, so 
that for all k one has '^^aknPni°o) 0. This inequality is 
strict at least for k = I. Eq. (fTOl) shows that S[p{oo)\p{t)] 
now decays to zero meaning that p{t) relaxes to p{oc). 
This relaxation is due to the non-linearity of (|12p : it is 
impossible without feedback. 

Eq. p3)l for the phases integrates as 



Mr) 



Pn{T)bi, 



^{{l\n') {n\A\l)}l20) 



where Pn{T) satisfies to the algebraic equation (jTH]). Note 
that bin is symmetric: bin = bni- Eq. (|20p gives the 
phases of the adiabatic (linear) feedback control. It is 
clear that (j>i{T) is free of the constraints for the open- 
loop (Berry) phase (f>B,i' it is explicitly gauge- invariant 
together with 6;„; ii) its existence does not require com- 
plex adiabatic eigenvectors [/), provided that the moni- 
toring observable A has at least some complex elements 
Hi) it does not require several control parame- 
ters for cyclic processes; iv) even if a„i, defined via p5|). 
is zero, i.e., if the probabilities Pn are conserved, the 
feedback-driven phases 0; in (|20p can be non-zero. Note 
that 0i = if the evolution starts from a strictly one adi- 
abatic eigenvector p„(0) = dnk (however this stationary 
state of (fT2|) need not be stable, as we saw above). 

Examples. We now apply our findings to two simple ex- 
amples. For a two-level system (IT^ [T5)) reduce to pi (r) = 
i-i-p^j^^(o)|e''i2^--i] I which means that independent of the ini- 
tial value pi{0), pi —> I (pi 0) if 012 > (012 < 0). 
Properly choosing the time r and ai2 , and knowing pi (0), 
we can reach any value < pi(r) < 1. Eq. (|20p leads 
to 0i,2(t) = ±^ln[pi(0)(eT''i=^^ - 1) + !]• Two basic 
examples of two-level systems are the spin-i and the po- 
larization states of light. The standard Berry phase was 
observed in both these cases Q. 

For the three-level situation the internal stationary 
vector is obtained from (|17p (up to normalization) 

pi(oo) cx 023/012, P2(oo) oc -ai3/ai2, Paioc) cx 1,(21) 
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provided these probabilities are positive, i.e., (using 
game-theoretic terms) the group 1 beats 2, 2 beats 3, 
but 3 beats 2 (rock-swissor-paper game). Now the r- 
dependent solution p(r) of oscillates around (pij) . 
Naturally, if one group (say 1) beats both others (ai2 > 0, 
013 > 0), the only attractor of is p{oc) — (1,0,0). 
The latter conclusion holds also for a r-dependent R, if 
the conditions ai2(r) > and ai3(r) > are satisfied for 
all r's. However, the general arguments (fl6l - [T9|) do not 
proceed for r-dependent ain- 

Mixed states. So far we focussed on pure states of the 
quantum system. Now we assume that the quantum state 
p is mixed and the feedback goes via the average tr(Ap); 
compare with ([2]). Since the closed loop equations ([T]) 
is not linear, the mixed-state dynamics (in general) does 
not reduce to the pure case. Defining for the adiabatic 
amplitude Cnm = (n|/9|m)e*'''"~*^" [compare with (|4])], 
and proceeding along the lines of ([3] [H) leads to 



■ R*Cnm{{n\n') + {m'\m)) 

An\l')AinCnlCljn-y2,/^ 



(22) 
{l'\m)cniCi„iA 

(23) 



is a parameter 
Eq, 



There is a case where the pure-state analysis applies di- 
rectly: Pseudo-pure states in NMR are important for 
ensemble computation and are given as p = (1 — 77)^ + 
ry [■(/') ("01, where 1 is the unit matrix, and where < 77 < 1 
|. Since 1 is an invariant of (P^ . 
reduces to (fTU)) . but with Ani rj^Ani. In 
general the phases of c„m do not decouple from |c„m|, 
and we do not have a general theory for mixed states. 

Let us study in more detail the hybrid dynamics A — 
—dfiH; see our discussion after This is a pertinent 
example, since its pure-state dynamics is straightforward: 
due to Ain = {En ~ Ei)\{l'\m)\'^, the new phases (HOI) 
nullify, while p2|) for the probabilities predicts relaxation 
to the ground state (cooling). The mixed-state dynamics 
will be seen to be more interesting. Eq. ([^^ implies 



2E 



(Ei~En)\{l'\m)\ 



Let n = 1 be the lowest energy level. If all |(^'|1)| differ 
from zero, c;^i has to nullify for large r, since cn should 
be limited. Continuing this way for n > 1, we get that 
all non-diagonal elements c„^/ nullify (decoherence) , if 
all |(?'|n)| are positive. 

If, however, |(r|n)| ~ for some n ^ I, the element 
Cni survives and undergoes a non-trivial evolution. An 
example of this is presented in Fig. [TJ Here the field R 
acts only on energy levels 2 and 3; the level 1 does not 
feel R. Thus |(2|1')| = |(3|1')| = and |(2'|3)| > 0. 
Nevertheless, C12 and C13 do change in time. In Fig. [T] 
all ci^n are real, and we see that C13 changes its sign, an 
example of the adiabatic phase. Though C23 has to decay 
to zero, it can increase in the intermediate times. 



In summary, we studied how the feedback generated 
by non-disturbing (ensemble) measurements affects the 
adiabatic (i.e., slowly driven) quantum dynamics. For 
the simplest linear feedback we have found that i) the 
populations are no longer constant. Instead, they sat- 
isfy the canonical [replicator] equation of the population 
game theory, allowing us to visualize the corresponding 
dynamics as a zero-sum game played by the adiabatic 
energy levels. The [non-linear] replicator equation gener- 
ates a non-trivial (possibly chaotic) Hamiltonian motion, 
or alternatively, relaxation towards a certain state, ii) 
In addition to the Berry phase, the feedback generates 
a new, explicitly gauge-invariant phase, which [as com- 
pared to the Berry phase] exists under a wider range of 
conditions. In particular, there are scenarios of feedback, 
where the probabilities are constant (resembling the or- 
dinary situation), but the new phases are still non-trivial. 
These results extend to pseudo-pure quantum states. 

The work was supported by Volkswagenstiftung grant 
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